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Abstract — Electricity peaks can be harmful to grid stability 
and result in additional generation costs to balance supply with 
demand. By developing a network of smart appliances together 
with a quasi-decentralized control protocol, direct load control 
(DLC) provides an opportunity to reduce peak consumption 
by directly controlling the on/off switch of the networked 
appliances. This paper proposes a packetized DLC (PDLC) 
solution that is illustrated by an application to air conditioning 
temperature control. Here the term packetized refers to a 
fixed time energy usage authorization. The consumers in each 
room choose their preferred set point, and then an operator 
of the local appliance pool will determine the comfort band 
around the set point. We use a thermal dynamic model to 
investigate the duty cycle of thermostatic appliances. Three 
theorems are proposed in this paper. The first two theorems 
evaluate the performance of the PDLC in both transient and 
steady state operation. The first theorem proves that the average 
room temperature would converge to the average room set 
point with fixed number of packets applied in each discrete 
interval. The second theorem proves that the PDLC solution 
guarantees to control the temperature of all the rooms within 
their individual comfort bands. The third theorem proposes 
an allocation method to link the results in theorem 1 and 
assumptions in theorem 2 such that the overall PDLC solution 
works. The direct result of the theorems is that we can reduce 
the consumption oscillation that occurs when no control is 
applied. Simulation is provided to verify theoretical results. 

I. Introduction 

It is well known that the day-to-night electricity usage is 
oscillatory, with a usage valley appearing through the night 
and a peak occurring during the day. At the same time, high- 
frequency (minute-to-minute and faster) oscillation results 
from randomly occurring aggregations of individual loads 
with short duty cycle [1]. The importance of reducing high- 
frequency peaks in usage is multi-fold. We can more easily 
maintain the stability of the grid with reduced amounts of 
generation reserves such that the grid frequency and voltage 
are stable. Generation cost can be reduced since we will 
not use generators with large marginal costs. Among all 
classes of electricity demand, thermostatic loads have been a 
major contributor to problems of high peak usage [2]. At the 
same time, thermostatic loads provide thermal capacity such 
that we can regulate their usage pattern as long as certain 
baseline thermal requirements are met. This paper presents 
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an approach to carrying out such regulation by means of a 
novel information-based method for direct load control. 

Historically, thermostatic loads (air conditioners, electric 
space heating systems, water heaters, etc.) have been oper- 
ated in an uncoordinated fashion resulting in the power grid 
being exposed to costly random load fluctuations. Taking 
note of the past decades's development of networked control 
system technologies [3] and novel concepts enabled by smart 
appliances, such as the so-called Internet of Things [4], we 
shall study the control of a local network of loads wherein 
the objective of control is to suppress spikes and fluctuations 
in usage. The approach uses real-time data from individual 
devices and local temperature sensors communicating with a 
central operator who distributes quantized amounts of energy 
to service the load demands according to a protocol for direct 
load control (DLC) that we shall describe below. 

Various approaches have been proposed to formulate the 
DLC problem with the objective of peak load management. 
The load curve has been studied using a state-queueing 
model where thermal set points are adjusted automatically 
as a function of electricity price or outside temperature in 
[5] and [6]. Dynamic programming has been applied in 
[7] to minimize the production cost in a unit commitment 
problem, and in [8] to minimize the disutility of consumers 
resulting from DLC disruption. Monte Carlo simulation has 
been applied in [2] to evaluate the effectiveness of a specific 
DLC approach which minimized the discomfort of overall 
temperature deviation subject to constraints in transmission 
lines. Multi-server queueing theory has been used to cal- 
culate the mean waiting time of consumers when the usage 
authorization is limited during peak hours in [1]. This system 
has been applied in a total of 449 residential units located 
in Seoul with good performance. 

The objective of our approach is to monitor and control 
aggregate electricity use in order to avoid random spikes 
in demand that would otherwise occur. The mechanism that 
implements the approach is something that we call packetized 
direct load control (PDLC). The term packetized refers to the 
idea of time-packetized energy where the central operator 
authorizes electricity usage of individual loads for a fixed 
amount of time Af. After the elapse of time Af, the central 
operator reschedules the authorization. For each building, the 
central operator is connected to the on/off switch of thermo- 
static loads (fan coils or room air conditioners). Users in the 
building are assumed to authorize the operator to control the 
on/off switch of their thermostatic smart appliances once they 
provide the operator their preferred temperature set point. 
The central operator, who receives thermal information on 



all the appliances at each decision instant, has the objective 
to maintain all appliances within their comfort band by 
selectively turning on or off these thermostatic loads at 
discrete time instants. The PDLC provides flexibility in 
adjusting building consumption since we are actually dealing 
with a discrete time decision making problem where the 
central operator schedules packets at the beginning of each 
interval. It will be shown that given a minimum critical level 
of energy capacity, it is possible to both eliminate demand 
peaks and guarantee a narrow comfort band around each 
consumer's preferred temperature setting. In a theoretical 
sense, it is further shown that the width of the comfort 
band can be made to approach zero by letting the packet 
length approach zero, although practically speaking the cycle 
time of an air conditioning unit cannot be made arbitrarily 
short. In the end, the PDLC solution is able to smooth the 
consumption oscillations, and this in turn enables buildings 
to consume smaller amounts of reserves dispatched from the 
ISO. 

The remainder of the paper is organized as follows. 
Section [II] introduces the set up of the PDLC mechanism, 
followed by the investigation of a thermal model in section 



III Section IV and [V] discuss the transient and steady state 



operation of the PDLC solution respectively. Section VI dis- 



cusses an allocation solution to link theorem 1 and theorem 



2. A robustness analysis is given in section VII Section VIII 
provides simulation results. Section [IX| concludes the paper 
and proposes future work. 

II. The PDLC Mechanism Setup 

This section describes the model in terms of which the 
PDLC mechanism is proposed. The following few points 
compose the background of the proposed approach. 

(1) The PDLC controls the thermostatic loads in a build- 
ing, such as air conditioners, refrigerators, and water heaters. 
The thermal dynamic model of these appliances does not 
differ much; the investigation of the thermal model of air 
conditioners in the next section can be extended to other 
thermostatic loads with minor change. 

(2) The PDLC is assumed to be an on/off control. All the 
appliances are assumed to running with rated power if packet 
is authorized, or consume nothing if packet authorization is 
denied. There is no intermediate operation choice. 

(3) Different feeders are in charge of different types of 
loads, and they are all connected to the central operator 
who schedules electricity packets. The loads that have been 
grouped together in the same feeder consume energy at the 
same rates when they are operating. The overall consumption 
of the building is the sum of the consumption in each feeder 
controlled by the PDLC mechanism plus a certain portion of 
uncontrollable loads, including lighting and plug-in devices 
such as computers, televisions, and other small appliances. 
We assume that the consumption of the uncontrollable loads 
is independent of thermostatic loads and the environments 
(temperature, humidity, etc.), and these uncontrollable loads 
are subtracted from the analysis of the PDLC framework. 



(4) It is assumed that the target level of consumption in 
each feeder of thermostatic load is available beforehand, 
which is defined as the average consumption during peak 
time when no control is applied. The value of the proposed 
method rests on the evidence-based assumption that the con- 
sumption curve without control would oscillate around the 
target level, and consumption peaks will frequently exceed 
the target level by a significant amount. The control objective 
of the PDLC is to make the consumption curve smoother 
around the target level with minimum oscillation. 

III. Air Conditioner Thermal Model 

A model of the thermal dynamics of an air conditioner 
is developed as follows. Ihara and Schweppe presented a 
dynamic model for the temperature of a house regulated 
by air conditioning, and this has been shown to capture 
the behaviour of air conditioner loads accurately [9]. The 
temperature dynamics in continuous time (CT) is given by 

dT _ T out - T 
dt T 

where T out is the outside temperate, T g is the temperature 
gain of air conditioner if it is on, T is the effective thermal 
time constant of the room, and u is binary valued specifying 
the state of thermostat. The unit of parameters is Fahrenheit 
as in the original paper. The temperature dynamic model in 
discrete time (DT) with interval At is given by 



T g u 



(1) 



T k+1 = (1 - a)T k + aT 0Ut - bu k , 



(2) 



where a = l—e~7, b=aT g , and u k is m's value during the 
A:-th interval. We first derive the duty cycle off -time t ff and 
on-time t „ based on the CT model for the case in which 
there is no PDLC and the air conditioner is operating in the 
traditional way under the control of its own thermostat. T mwc 
and T m j„ are the comfort band boundaries. To get t ff, we set 
u = in ([TJ, which means that the air conditioner is turned 
off. Rearranging terms we have 



dT } l T T ""> 

dt T T 

whose general solution is given by 

T(t) =Ce-* + r J 



= 0. 



(3) 



(4) 



Since t ff is the time that temperature arises from T m i n to 
Tmax in the case of traditional thermostat control, we choose 
initial condition T(0) — T m j n to solve for t a ff. See FigJT] 
C = T^ — T out . The overall solution of temperature evolution 
is given then by 

T{t) = (T min - T ou ,)e'r + Tgu,. (5) 

The value of t ff would satisfy T(t ff) — T max . After calcu- 
lation we will have 



V/ 
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Tout T max 
Similarly we calculate t on when u=l, 
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can be expressed recursively as 
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We will have the difference between T"^' t e and average room 
temperature at time k + 1 given by 

A* 
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(13) 



For any small deviation e > from T"J e , we will have 
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Fig. 1. Typical air conditioner duty cycle 



The traditional duty cycle dynamics characterized by t a ff 
and t on provide the baseline against which the PDLC protocol 
of the next section is evaluated. To evaluate the PDLC 
solution, we consider its transient and steady state operation. 
The next section will discuss its transient operation. 

IV. Transient Operation of the PDLC 

The motivation of the PDLC solution is to allow buildings 
consume electricity at a level that minimizes oscillation close 
to a target. Denote the total number of consumers by N c , the 
number of authorized packets by m, the set point in room ; 
by T s l er and the room temperature in room i at time k by Ti, 
The transient process is defined as the duration before the 
average room temperature converges to the average room 



set point T"^ e = ^-L^i^'er- The theorem below provides 
a solution that guarantees the convergence of average room 
temperature under the assumption that m packets are being 
allocated to a pool of appliances during each packet interval. 

Theorem 1. If the fixed number of packets m = N c T " l " T Txt 
is used in each time interval At, then the average room 
temperature Tg ve — i- J\£j T l k converges to the average room 
set point T™ t e . 

Proof: We use the DT model to derive the convergence 
of the average room temperature. According to we can 
represent the number of authorized packets in terms of the 
DT model parameters a and b as follows 



Y TCtve 

T. T 1 out 1 set 

m = N c — 



= N c {T out -T™Y 



(8) 



In one packet length, the total temperature decrease Tj? ec by 



m packets is given by 

T k dec = mb = N c a(T 0l 



<T>ave \ 
L set )•> 



(9) 



where the last equality follows from (|8j. Similarly, the total 
temperature increase T£" c , which is caused by indoor/outdoor 
temperature difference, is given by 



after k steps, with k satisfying 



r I T ave - 
k>-ln 1 ^— 
At e 



r^ave I 
J 



(15) 



This means the average room temperature will converge to an 
arbitrarily small neighbourhood of T"^ t e after finite number 
of steps. ■ 

We say that the system is in Steady State Thermal Equilib- 
rium (SSTE) when the average room temperature is within 
a sufficiently small neighbourhood of T" e v t e . If the system 
is in SSTE at time k*, then the system will be in SSTE for 

j- -rave 

k > k* as long as we provide m — N c 



packets at each 

interval. According to ( 15 i, the convergence speed depends 



on T^ ve and T. If these two parameters do not provide a quick 
convergence with few steps (7q" ,£! being large in a warm load 
pick up process), we can adjust the number of packets as a 
function of the average temperature deviation Tf ve — T"^ e at 
time k. Let the modified number of packets be given by 



m = N c - 



fave 
1 set 



[i+ 8 (Tr-T s T)], 



(16) 



where g is a non-negative coefficient. In this case, for any 
e > we can similarly prove that after k steps the deviation 
of average room temperature from T"^ e is smaller than e, 
with k satisfying 



k > -ln[l-(l 



, I T>ave 

")G]ln^_ 



Tave\ 
1 



(17) 



where G= 1 + g(T out — T££ e ) can be understood as the 



convergence gain parameter. Comparing (17i with ( 15 i, we 
have k <k for the same At since G > 1. The larger the value 



of G (or g), the quicker the convergence. If m in ( 16 1 is not an 
integer, we can choose the ceil \m~\ as the number of packets 
scheduled. The proof remains valid under this choice. 

Theorem 1 indicates that the average consumption is 
proportional to the total population N c by the coefficient 
"'" T — . The physical meaning of this coefficient is the 
thermostat mean status. Define 
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(18) 



4 nC = E a ( T '"" - T k) = N c aT <>ut -a^T* 

i=l i=l 

The total temperature change T[ h is given by 
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representing the mean on-status and off-status of the thermo- 
stat. These two variables will be used in the second theorem 
for the steady state analysis of the PDLC. Note that an 



essential implicit assumption is that 



< 1, i.e. there 



(11) is enough cooling capacity to serve the consumer population. 



V. Steady State Operation of the PDLC 



We have 



When no control is applied, each air conditioner will 
operate according to its own duty cycle as described in 



Sec III All the room temperatures are controlled around their 
respective set points, and the average room temperature is 
approximately equal to the average room set point, namely 
jave ^ T^ e , From the first theorem, the system will evolve 
into SSTE within a few steps when the PDLC is applied. We 
say that the system is in steady state at time k if it is in SSTE 
and T k £ (7^,7^) for all i. When the PDLC solution is 
applied in steady state, consumers in each room have the 
freedom to choose the set point to be whatever they want. 
After the set point is given, the operator will choose the 
comfort band for consumers around their preferred setting. 
The comfort band may be large or small, depending on the 
outside temperature and the energy we have purchased a 
day ahead. It is a compromise in the PDLC that consumers 
allow the operator to calculate the comfort band in order to 
achieve a smoother consumption. Denote the comfort band 
for room i around 7^ by (7^,7^) = {T l set - A 2 J' set +Ai) 
(A = Ai +A2 being a fixed value, namely we provide a fixed- 
valued comfort band for all the consumers). Define 



rpi _ T max aT out 
1 — a 



(19) 



as the critical temperature point of room i. The physical 
meaning of T c \ is the following: if room i's temperature 
exceeds T c \ at time k, then it needs packet at time k. 
Otherwise its room temperature will exceed T max at time 
k+1. The following two lemmas provide restrictions on how 
we choose Ai and A2. The first lemma provides a condition 
that the temperature of room i will not exceed T^ tax for 
all 2, and the second lemma provides a condition that the 
temperature of room i will not go below T^ in for all i. 
Lemma 1. Assuming the system is in SSTE, and TL £ 

i^mini Tmax) f° r a ^ ' at ^ me ^ we provide m packets, and 
A and A2 have been chosen to satisfy 



A2 m + 
A" < ~^ 



(20) 



then there exists 8 > such that T^ +1 < for all i with 
any packet length At e (0,5). 

Proof: If 7^ +1 > 7^, then we have at least m + 1 
rooms with temperature beyond their critical point at time 
k*. Enumerate the m + 1 (or more) consumers whose room 
temperature 7V* > T l cr at time k*:S — {h,--- , i m +i}- The 
remaining N c — m — 1 (or fewer) rooms' temperature are 
greater than T min for i = m + 2, ■■■ ,N C - The average room 
temperature lower bound at time k* is given by 



flow 
1 k* 



(21) 



*rlow 'rave 1 T l J _L V T V V*"c fi 1 

1 k* ~ 1 k* — N^lLijeS 1 cr -rLij^S 1 min ~ Lj= \ 1 set \ 

' j 

J_ fV T„ KU —aT ml i _ rn rplj 

— ff c lLij£l> l-« l^ij€S 1 set 

-(N c -m- l)A 2 ] (2T > 

x \Lij£S Tmax - (m + 1 ) T out }- 

\LijesT^„ +N C A 2 - (m + l)T 0Ul ]e-*. 
The first equality is derived from T™ e = -X- Y^li T s l et , namely 



k* ~ N c L*i=\ A set> 

at time k* in SSTE the average room temperature is equal 
to the average temperature set point. The second equality is 
derived from T l min = T l set — A 2 and ( 19 1. The last proportion- 
ality is derived by plugging a — 1 — e - ^ from 02b. 



If we choose A and A2 to satisfy ( 20 1, then 



(m+l)T ol 



(m+l)T ol 



y ■ t j 

L*ij^S min 



< 1. 



-N C A 2 



(23) 



Note that the above inequality is strict, so there exists 8 > 
such that 



(m + 1 ) Tout ~ Ej'.-eS Tmax 

(m+l)T out -Z lj£S T; t j in -N c A 2 



(24) 



Letting At = 8 in (22 1, we have = T$ 



Since (22 1 is 



monotonically decreasing as a function of At, then for packet 
length At € (0, 8) we will have T^ w - T™ e > 0. Namely the 
average room temperature lower bound is greater than the 
average room temperature, which is a contradiction. We must 
have 7£ +1 < T' wx for all i. ■ 

Lemma 2. Assuming the system is in SSTE, and € 
(Tmi n ,T max ) for all i at time k*, if we provide m packets, and 
A and Ai have been chosen to satisfy 

(25) 



Ai < 
A 



then there exists 7 > such that T^ +1 > T min for all i with 
packet length At e (0,7). 

Proof: The proof is similar to lemma 1. We first assume 
that < T^ jn , then derive a average temperature upper 

bound T^f p at time k* which is smaller than TS e to show 
contradiction. We omit the details. ■ 

Based on the above two lemmas, we provide the following 
theorem for the steady state operation of the PDLC. 

Theorem 2. Assuming that the system is in SSTE at time 
k*, and 7£ e (7^,7^) for all i, if we provide m = s on N c 
number of packets over time and choose Ai,A2 such that 



Ai 
A 



N c — m 



s off, 



A 2 



m 



then T k G (J l mbl X ma x) for all i and k > k* 
length At G (0,min{5, 7}). 



?on, (26) 
1 with packet 



Proof: Clearly ( |26| > satisfies ( 20 1 and ( 25 1, and with packet 
length At £ (0,min{5, 7}) both lemma 1 and lemma 2 will 



stand. We will have 7^* +1 



£ (V 



nnnJmax) for all 1 Since we 



provide m — s on N c packets at time k*, the system is also 
in SSTE at time k* + 1. By mathematical induction we can 
prove that T' e {T^T^) for all i and k > k* + 1. ■ 

Remark 1. As the comfort band A — >• 0, we have Ai — > 
0,A2 — > 0,T^ jn ps T^jc, Vi. According to (24 1 we must have 



Af — > 0, which means we switch packets at increasingly large 
frequencies. In this case, individual room temperatures will 
stay at individual room set points after time k > k* once 
fi* fa T^j at time k* for all This means that the width of 
the temperature band can be made to approach zero by letting 
the packet length approach zero. In actual implementation, 
there are practical limits on the minimum acceptable value 
of Af, say 30 seconds or 1 minute, since the air conditioning 
unit cannot be switched on and off at an arbitrary frequency. 
Hence, convergence is to the comfort band and not to the 
actual set point. 

Remark 2. From d26l, A] = s a f j A, A2 = s on A. When 
Son > s off> we have A2 > Ai. This can be explained by the 
intuition that since we are providing packets to more than 
a half number of consumers (s on > 0.5), it is more likely 
to have consumers being over-cooled. Thus we set a larger 
value of A2 to avoid such an occurrence. Similarly when 
Son < s ff, we set a larger value of Ai to avoid consumers 
being over-warmed. 

Remark 3. Based on the weather prediction, the building 
would purchase certain amount of packets a day ahead. In 
real time, the number of packets may not be enough if the 
predicted temperature is lower than what is actually realized. 
With the PDLC solution, the operator does not need to 
purchase additional energy from the real time market when 
the price is high. The operator can make packets switch more 
frequently to guarantee temperature control. In such cases, 
the average room temperature will converge to another value 
within the comfort band. 

Remark 4. The packet length above is a theoretical value 
to guarantee temperature control in steady state. In the proof 
we focus on the worst case when initially at time k* the 
temperatures of many rooms are in the vicinity of their 
maximum or minimum comfort boundary. In practice, the 
initial temperatures will be distributed more evenly across 
the comfort band. In such cases, the practical packet length 
can be larger than the theoretical value. 

Remark 5. In our model we assume that the operator 
achieves all the temperature information within the building, 
and such information is continuous. In a companion technical 
report [11], we assume that the operator must act on more 
restricted information. In this model, the appliance pool 
operator does not have complete and continuous access 
to appliance information, but instead receives requests for 
electricity that appliances send based on their own sensor 
readings. The operator receives packet request (withdrawal) 
from room i when its room temperature reaches T* nax (T^ in ). 
The total number of available packets is limited which is 
equal to the expected average consumption. Packet supply is 
modelled as a multi-server queuing system with fixed service 
time (packet length). In a stochastic simulation, at certain 
times consumers have to wait to be served, and at other 



times the total number of packets cannot be fully used, see 
Figj2] This indicates that continuous temperature information 
and control by an appliance pool operator results in a better 
control solution than binary information. 



Reaul&ton in the Surri 




70 60 90 



Fig. 2. Number of packets consumption and waiting consumers 

VI. From SSTE to Steady State 

The final question is how we start from SSTE and find 
a packet allocation mechanism such that at time k* we can 
start at TL € (T^^T^.) for all i. According to the discrete 
time thermal dynamics, 

Tk+i — Tk + a(T out - T k — u k T g ) 

= Tk + (1 - e~%){T om -T k - u k T g ) 

= T k + (1 - (1 - «-T + o(At)))(T out -T k - u k T g ) 

*T k (l- Y ) + Y (T 0Ut -u k T g ), 

(27) 

where the third equality and fourth approximation are by 
Taylor series expansion for small packet length Af. By a 
similar derivation we have, 



T k +2 ~ T k+ \ (1 — y) + T (Tout — UkT g ) 

= T k (l - ?f) + ^(2T out - (u k + u k+l )T g ), 



(28) 



where the second equality is obtained by plugging into ( 27 1 
and ignoring terms of o(Af) for small Af. For intervals, 
we have, 



NAt , At , 
T k+N = T k {\ ) + -{NT out - 

T T 



N 
z=0 



Denote 



N 

1=0 



(29) 



(30) 



as the number of packets received within periods, then the 
temperature at time t +N is given by, 



NAt, At , 

T k+N = T k (l ) + -{NT out 

x x 



(31) 



Having discussed the discrete time temperature evolution, we 
propose the following theorem to guarantee that if we start 



from SSTE, then there exists a packet allocation solution to 
satisfy the assumptions in theorem 2. 

Theorem 3. If the aggregate system is in SSTE at time k 
(per the conclusion of Theorem 1), let «, denote the number 
of packets received by room i over the next N successive 
time intervals of length At. There exists a choice of packet 
allocation {«i,«2, . . . ,«jv r } such that each room temperature 
is within the consumer's designated comfort band at time 
k+N. That is, T' k+N G [T; nin X nax ), with the total of allocated 
packets satisfying 

N c 

£ m = mN. (32) 

i=l 

Proof. According to pi) , after a total number of n, packet 
consumption in a successive N periods starting at time k, the 
temperature in room i at time k + N is given by, 



T' 



NAt At, 

n a — — +v { - NT °"'- 

X X 



■HiTg) 



The allowable choice of «; such that TL N G (T^ et — A\ , T l set 

(Tl-T' e ,-A 2 )'C+NAt(T m „-Ti) 



Ai) is given by, 

(V k -n e ,+^)x+NM(T ml , -ff) 



> n; > 



AtT„ 



(34) 

In order to have at least one integer «, within the bounds 
above, we need to have, 



(T'-T^+A^r+NAtjT^-T') (T<-Tl e ,-A 2 )t+NAt(T mll -T') 



A/To 



Arr„ 



> 1, 



which can be achieved with a packet length 

(Ai+A 2 )t 



At < 



We introduce the floor and ceil operator [ J, [•]■ Let 



a. 



, (q-4,+Ai)T+jVAf(r „,-r/) , 

L AtT„ J ' 



_ r ( T k- T L-^+NAt(T mlt -T') 



(35) 
(36) 

(37) 



At T e 



then n; can be chosen from integers between a' k and fij,. If 
the following inequality holds, 

N c N c 

£q[ (38) 

i=i i=l 

then there exists a choice of packet allocation 
{ni,«2, ■ ■ • ,kn c } such that |34| holds and 

N c 

m = mN. (39) 



Note that 

N c 
(=1 



> 



n 



L \ AtT g 
i=l s 

it T[-f T^+NcA^x+NAt^NcT^-f T<) 



> 



NN c (T ol „-T™) 

>nN + N c (^ g 
mN, 
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(40) 



and this holds as long as we choose At such that > 1. 
In the derivation above, the third equality is obtained by the 
SSTE at time k satisfying 



N c N c 



N T a 



(41) 



With similar derivation, a packet length At such that > 1 



will guarantee the second inequality in (38 1. To summarize, 
a packet length satisfying 



At < min{Ai,A 2 }; 



(42) 



will make (38 i hold. This ends the proof of theorem 3. ■ 

Remark. According to ( |4"2"| ), the upper bound of packet 
length is directly proportional to x and inversely proportional 
(33) to T g . The intuition is that large value of x impedes and T g 
facilitates the thermal transmission, which allows larger and 
requires smaller packet length respectively. 

The remaining issue is to assign m packets at each 
period. Denote ay as the binary variable representing packet 
assignment at time k for room ;. Up to time k + j, define 



k+j 

ni{k+j) =tii-Y, a iJ 

l=k 



(43) 



as the remaining number of packet needed for room i until 
time k+N. A simple allocation algorithm works as follows, 
starting at time k we allocate packets to the m rooms 
with largest n,(&). Let an — 1 if packet is allocated and 
otherwise. Use (43 1 to update «,(&:+ 1) for all i. Repeating 
such allocation procedure until the end of interval £+Af will 
guarantee m allocation each period. 

We first prove the following inequality of «,•(& + j), 



0< ni (k + j)<N-j. 



(44) 



We prove with induction. Note that for j = I = is it 
apparently true. Also at time k + l, 

N c 1 N c 

Y j n i {k + l)=mN-Y J t, a Uk+j =™{N-l). (45) 
i=l ;'=0i=l 

For j = 1 + 1, we proof with contradiction. If there exists 
a room ;'* such that «;*(& + /) < N — I and + / + 1) > 
N — l—l, then npik+t) =N—l. It also indicates that room i* 
does not get a packet and there are at least m rooms, indexed 
by i J ,j= l,...,m, other than /* such that rip (k + l) =N — l 
to get packets. Then 

N c in 

Zni{k+l)> n i j(k+l)+n l -*(k + l) 

«=l y=i (46) 

= (m+l)(N-l), 



which contradicts (45 I. So we will have ni(k+l + 1) <iV- 



/ — 1 for j = 1 + 1 and all i. 

To show that ni(k+l + \) > for all i. Suppose that rii*(k + 
l + l) < 0, it indicates that np(k + l) = and room z* gets 



a packet. Thus there are at most m — 1 rooms, indexed by 
1 



m — l, with positive value of n i j{k + l) > 0. Then 

(47) 



N c m- 1 

l t n i {k+l)= £ «,■;(* + /) +Bj*(jfc + /) 



< (m-l)(iV-/), 



contradicting (45 1 again. So we will have rii(k + 1 + 1) > 
for j = 1 + 1 and all z. Using mathematical induction, for all 
i=l,...,N c and j = 0,...,N, Q holds. Then for j = N 
and all i, we will have 



m(k+N) = 0. 



(48) 



Namely all the rooms will have received the exact packets 
they need and T[ +N e {T^.T^) for all i with m packets 
allocation for each period. The intuition of such allocation 
is to provide packets to the m rooms that have largest 
temperature deviation above their target, namely at time 
k + j the m rooms with largest j) receive packet for 

./ V. 

To summarize, theorem 1 guarantees that the systems will 
evolve into SSTE, theorem 3 guarantees that starting from 
SSTE we have an allocation solution such that we can have 
TL within the comfort band of room i for all i, and theorem 2 
guarantees temperature control after the allocation. The three 
theorems complete the overall PDLC mechanism. 

VII. Robustness Analysis of the PDLC 

While Ihara and Schweppe's model [9] is deterministic, we 
have also considered temperature disturbances to get a ther- 
mal model that reflects uncertainty. Temperature disturbance 
in real life may come with the inaccuracy of sensors, the 
unpredictability of consumers, etc. The revised temperature 
dynamics is therefore given by 

c/T _ T mit -T -Tgu + ejt) 
dt ~ t ' 



(49) 



where e(t) is a bounded thermal stochastic disturbance 
uniformly distributed between [—£,£]. We investigate the 
transient and steady state operation of the PDLC solution 
under this model of disturbance to illustrate the robustness 
of the PDLC. The discrete version of the model becomes 



T k+ i = (l-a)T k + aT om -aT g u k + ae k . 



(50) 



Repeating the derivation in theorem 1, the average room 
temperature evolution from time k to k + 1 given by 



-rave -rave 

l k+\ ~ l k 



ave <j 



a ^ i 



N, 



(51) 



Note that the term jj-YdJLi e' k is bounded between [— aS,ae\. 
When packet length At is small, a will approach zero, and 
this makes the disturbance term approach zero. Then the 
average room temperature will still converge to T™ t e . 

As for the steady state operation, we will have the same 
comfort band selection as in Theorem 2, namely Ai = 
s //A,A2 = s on A with the difference in the boundary of 
packet length selection. In the model with disturbances, we 



can similarly derive the contingent packet length 8 and y as 
in lemma 1 and 2. For example, the value of 8 will satisfy 



-i)(r M 



-i)(r OT 



(52) 



Compared with (24i, the only difference is that the term 
T out in p4|) is replaced by T out +£. Hence the disturbance 



in (49 1 can be understood as the uncertainty introduced by 
the outside temperature. Also, the above 8 is smaller than 
the 8 in lemma 1. This is no surprise since the existence of 
uncertainty forces us to switch packets more frequently. 

VIII. Simulation 

A. Air Conditioner Temperature Control 

We simulate air conditioner temperature control process 
to verify theoretical results. Environmental parameters are 
T g = 40,T om = 93, T = 20, N c = 100, e = 10. Consumers 
preferred set point is T* et = 73 for all i. After calculation 
we choose T max — 74, T m i„ — 72, At = 1. Fig. 3 is the process 



of warm load pick up. Fig 3(a) shows that the average room 



temperature converges to the set point when we applied the 
number of packets at time A: as a function of T k ave — T£ 



ave 
set ' 



which verifies theorem 1. Compared with Fig 3(b) where 
no control is applied, the consumption oscillation by the 
PDLC solution is reduced by a large amount after the system 



evolves into SSTE. The oscillation magnitude in Fig 3(b) 
continues to exist if we simulate for longer time. Fig. 4 
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(a) Warm load pickup process with the PDLC 
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(b) Warm load pickup process without control 
Fig. 3. Loads start outside the comfort zone 



is the steady state process where all the rooms have their 
initial temperatures randomly distributed within their comfort 
bands. We see two main advantages of our PDLC solution. 
First, the maximum and minimum room temperature are 
controlled within the comfort band in steady state, which 
cannot be achieved without control since then the disturbance 
drives the temperature outside the comfort band. Second, the 
consumption process is smoother with PDLC solution than 
in the stochastic uncontrolled case. 
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(a) Steady state operation with the PDLC 
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(b) Steady state operation without control 
Fig. 4. Loads start in the comfort zone 

B. Multiple Appliances Simulation 

Consider the simulation of multiple appliances. The con- 
trollable thermostatic loads are air conditioners and refrig- 
erators. We also add uncontrollable loads, such as light- 
ing and plug-in devices. The thermal characteristics of the 
refrigerator is similar to the air conditioner. Refrigerator 
parameters is given by T set = 35, T g = 15,T uut = 73, T = 185, 
we choose T max = 38,T m j„ = 32. t on and t a ff are around 
20 minutes according to |6} and |7]), which is typical 
duty cycle of refrigerator [10]. We assume there are 60 
refrigerators each consuming around 600 watts of power. 
The air conditioner consumes around 3kW each. There is 
also an industrial chiller that consumes with small variation 
in steady state, which is uniformly distributed between 
[135, 145]£VK. Uncontrollable loads are uniformly distributed 
between [180,200]A:W. Table. 1 shows the comparison result 
between the PDLC solution and the case when no control 
is applied. We find that standard deviation of consumption 



TABLE I 

Comparison of Consumption Statistics 





Mean 


Std Dev 


Maximum 


Minimum 


PDLC 


725.86 


8.18 


744.09 


709.92 


No Control 


724.11 


15.06 


761.43 


687.23 



by the PDLC solution is nearly half of that without control. 
Also the maximum electric usage is reduced nearly 50% from 
above its average. 

IX. Conclusions and Future Work 

This paper proposes an innovative PDLC solution for 
demand side management. We have discussed a thermal dy- 
namic model of typical thermostatic appliances and derived 
a mathematical expression of its duty cycle. Three theorems 
are proposed to illustrate overall PDLC solution. The first 
theorem proves the convergence of the average room temper- 
ature to average room set point. The second theorem provides 
comfort band choice such that we can guarantee effective 
temperature control in steady state. The third theorem builds 
the bridge between the first two theorems. Simulation shows 
that the PDLC solution can provide comfortable temperature 
control with minimum consumption oscillation, and reduce 
consumption peaks at the same time. 

Future research will compare the performance of the 
PDLC as described here with comparable distribution control 
approaches using market based signaling. Renewable energy 
sources will be included, and the dynamics of an appliance 
pool operator buying and selling resources under different 
communication protocols will be studied. 
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